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1. Introduction 



This paper consists of variations upon a theme, that of limiting modular symbols 
introduced in [0]. We show that, on level sets of the Lyapunov exponent for the 
shift map T of the continued fraction expansion, the limiting modular symbol can be 
computed as a Birkhoff average. We show that the limiting modular symbols vanish 
almost everywhere on T-invariant subsets for which a corresponding transfer operator 
has a good spectral theory, thus improving the weak convergence result proved in . 



We also show that, even when the limiting modular symbol vanishes, it is possible 
to construct interesting non-trivial homology classes on modular curves that are as- 
sociated to non-closed geodesies. These classes are related to "automorphic series", 
defined in terms of successive denominators of continued fraction expansion, and their 
integral averages are related to certain Mellin transforms of modular forms of weight 



two considered in . We discuss some variants of the Selberg zeta function that sum 
over certain classes of closed geodesies, and their relation to Fredholm determinants of 
transfer operators. Finally, we argue that one can use T-invariant subsets to enrich the 
picture of non-commutative geometry at the boundary of modular curves presented in 
0. 



2. Modular symbols and geodesics 

Consider the classical compactification of modular curves obtained by adding cusp 
points G\P^(Q). Given two points a, /5 e EI U P^(Q), a real homology class {a, (3}g e 
Hi{Xg, M) is defined by integrating the lifts by : H — >■ Xq of differentials of the first 
kind on Xq along the geodesic arc connecting a and /?, 

u := (f)*uj. 



'{a,/3}G -^a 

The modular symbols {a,f3}G satisfy the additivity and invariance properties 

{a, /3}g + {/3, i}g = {a, 7}g, 



■^Partially supported by Humboldt Foundation Sofja Kovalevskaja Award. 
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and 

{ga^gpjc = {a,/5}G, 

for all g & G. 

Because of additivity, it is sufficient to consider modular symbols of the form {0, a} 
with a G Q, 

n 

{0, a}G = - ^{gkiO),gkiioo)}G, 

k=l 

where a has continued fraction expansion a = [ao, . . . , a„], and 

with pk/qk the successive approximations, and Pn/qn = «• 

In it was argued that one can interpret the whole P^(R) with the action of G 
as a compactification of Xq, and a corresponding generalization of modular symbols 
was introduced, using infinite geodesies in the upper half plane H, which end at an 
irrational point in P^(]R). 

Let 7/3 be an infinite geodesic in EI with one end at zoo and the other end at /3 G M\Q. 
Let xq G 7/3 be a fixed base point, r be the geodesic arc length, and y(r) be the point 
along 7/3 at a distance r from xq, towards the end p. Let {x,?/(r)}G denote the 
homology class in Xg determined by the image of the geodesic arc {x,y{T)) in H. 

The limiting modular symbol is defined as 

(2.1) {{*, P}}g := lim - {x, t/(r)}c G H^{Xg, R), 

r 



whenever such limit exists. The limit ( p.l|) is independent of the choice of Xq as well 
as of the choice of the geodesic in EI ending at P, as discussed in . 

2.1. Shift. We shall study the limiting modular symbols using properties of the dy- 
namical system given by a generalization of the shift of the continued fraction expan- 
sion. For a modular curve 

Xg = PGL(2,Z)\(e x P), 
where P = PGL(2, 1j)/G, we consider the shift map 

T : [0, 1] X P ^ [0, 1] X P 



(2.2) T{P,t) 





T 


G- 


.P. 
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2.2. Lyapunov spectrum. Recall that the Lyapunov exponent oi the map T : [0, 1] 

[0, 1] is defined as 

1 1 ''"^ 

(2.3) X{f3):= lim - log | (T")'(/3) | = lim - log TT \T\T'(3) \ . 

n—*oon n— >oo 77, 

fc=0 

The function X{(3) is T-invariant. Moreover, in the case of the classical continued 
fraction shift T/5 = l/P — on [0, 1], the Lyapunov exponent is given by 

(2.4) A(/3) = 2 lim -logg„(/3), 

n^oo n 

with QniP) the successive denominators of the continued fraction expansion. In partic- 
ular, the Khintchine-Levy theorem shows that, for almost all /3's, the limit 
is equal to 2C, with 



12 log 2 



(2.5) C 

The Lyapunov spectrum is introduced (cf. p^) by decomposing the unit interval in 
level sets of the Lyapunov exponent A(/3) of (U). Let Lc = {P e [0, 1] |A(/3) = c G M}. 
These sets provide a T-invariant decomposition of the unit interval, 

[0, 1] = y U {/5 G [0, 1] \X{(3) does not exist}. 

These level sets are uncountable dense T-invariant subsets of [0, 1], of varying Hausdorff 
dimension . The Lyapunov spectrum measures how the Hausdorff dimension varies, 
as a function h{c) = dimj^ (Lc). 

We introduce a function ip :¥ Hi{Xa, cusps, M) of the form 



(2.6) ^is) = {giO),giioo)} 



Gi 



where g G PSL(2, Z) is a representative of the coset s G P. We can easily generalize 
the result §2.3 of []T6|, where the following is proved for the level set Lc-, with C as in 

Theorem 2.1. For a fixed c G M, and for all (3 G L^., the limiting modular symbol 
( ^.11 ) is computed by the limit 

1 " 

(2.7) lim — V</^oT'=(to), 

n^oo cn ^ — ^ 
k=l 



where T : [0, 1] x P [0, l]x¥ is the shift operator ( |2.2| ), and t^ ElP is the base point. 
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Proof. Without loss of generality, we can consider the geodesic 7^3 in EI with one end 
at ioo and the other at (3. Following the argument given in §2.3 of |]TB|, we estimate 



the geodesic distance r ~ —\ogQy + 0(1), as ?/(r) — >• f3. (Here 3?/ denotes the 
imaginary part.) Moreover, if i/n is the intersection of 7^ and the geodesic with ends 
at Pn-i{P) / qn-i{P) and Pn{P) / QniP) , then we can estimate 

< < 



G 



Moreover, notice that the matrix g^^[[3)^ with 

acts on points (/3, t) G [0, 1] x P as the /c-th power of the shift operator T of ( p72| 
Thus, for f(to) = {O,ioo}c, we obtain 

Finally, we can replace the path {xo,yn) with the union of arcs 

n 

{xo,yo) U {yo,Po/qo) U [J{pk^i/qk-uPk/qk) U {Pn/qn^Vn) 

k=l 

representing the same homology class in Hi{Xg, Z). 

□ 

2.3. Exceptional set. There is a set of /5 G [0, 1] of Hausdorff dimension equal to 
one, where the Lyapunov exponent does not exist (Theorem 3 of ||2^). On this excep- 
tional set the limiting modular symbols cannot be expressed as the limit ( p.7|) and the 
corresponding geodesic spends increasingly long times winding around different closed 
geodesies. 

2.4. Periodic continued fractions. A special case of limiting modular symbols is 
when the endpoint /? is a quadratic irrationality. In this case, /? has eventually periodic 
continued fraction expansion, hence it is a fixed point of some hyperbolic element in 
G. 

Recall that primitive closed geodesies in Xq are parameterized by periodic points of 
the shift operator T of (|3), T^{i3,t) = (/3,t). 



Lemma 2.2. Consider a geodesic 7^3 in EI with an endpoint at (3 Assume that (3 has 
eventually periodic continued fraction expansion. Then the limiting modular symbol is 
given by 

(2.8) {{*,Wg = . 
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Proof. Consider a geodesic 7/3 in H with an endpoint at (3. Without loss of generahty 
we may assume the other endpoint is at ioo. There is a hft 7/3 x {t} to H x P, such 
that T^{l3,t) = {l3,t), for a minimal non-negative integer i. 

For a quadratic irrationality (3 the limit A(/5) = 2 lim^^oo log(Q'n(/5))/'^ exists and 
belongs to the interval [21og((l + v^)/2),oo), cf. §4 of []2D[. Thus, we can apply 
Theorem ^?T] and obtain ( |2.8| ), where 

{g,\f3)■giO),g,\f3)■gi^^)}G 
is the homology class in Xq of the geodesic 



,Pk-i{(3) Pk{P)\ ^, r -1 



) X {g^\m 



□ 



In a different but equivalent expression for the limiting modular symbol for 



quadratic irrationalities is obtained, of the form 

(2-9) {{*, ajWc = — — , 

where {0, 5'(0)}g is the homology class of the image in Xq of the geodesic arc (xq, gxo), 
and are the pair of attractive and repelling fixed points of an hyperbolic element 
g E G, with < < 1 the respective eigenvalues, and \{g) = logA" is the length of 
the closed geodesic in Xq obtained from the geodesic in EI with ends at a^. 

3. Transfer and Gauss-Kuzmin operators 

We now treat the case of more general T-invariant subsets of [0, 1] x P. It is often 
possible to recast the dynamical properties of a map like our shift ( p.2|) in terms of the 
functional analytic properties of certain transfer operators. 

Definition 3.1. Let E <Z [0,1] x F be a T-invariant subset. The Ruelle (or Perron- 
Frobenius) transfer operator is defined as 

{nhf)i(3,t)= ^ exp{h{a,u))f{a,u). 

We only consider the case where the function h is of the form h{(3, t) = —s log |T'(/5)|, 
depending on a parameter s. 

For a T-invariant subset E G [0,1] x F of Hausdorff dimension 6e, we also define a 
generalized Gauss-Kuzmin operator, which is the adjoint of composition with T under 
the L^{E,T-C^'^) inner product, with H^'^ the corresponding Hausdorff measure. 
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Definition 3.2. Let E G [0,1] x F be a T-invariant subset of Hausdorff dimension 
6e- The Gauss-Kuzmin operator is defined by 

(3.1) [ (Cf) -hdn^^ = [ f ■ {hoT)dn^^, 

J E J E 

for all f,h m L'^{E,dn^^). 
Let A/i; C N be the set 



(3.2) := J A; : 



k + 1' k 



X p ^ 



Remark 3.1. The operator C defined by ( p.lD is given by 

1 . / 1 f I 
1 k 



(3.3) (£/)(fti)=E(^5TW^fc( 



In this case, we can consider a one-parameter family of deformed Gauss-Kuzmin 
operators 

(3.4) (':-/)(--')=E 0'') 

With this notation, the operator C of ( p.3[ ) is £ = C2Se,e- 



Remark 3.2. If the invariant set is of the form E = B x F with B defined by -B = 
{P G [0, 1] : G Af}, for P = [oi, ... , a„, . . . ], and A/" C N a given subset, then we 
have TZh = 'C2s,e, for h = —s log \ T'\. 

In general, these two operators differ. The Ruelle transfer operator tends to carry 
more information on the dynamics of T, while the Gauss-Kuzmin operator tends to 
have better functional analytic properties. The last Remark describes the optimal case. 

3.1. Spectral theory. We are especially interested in the cases where the Gauss- 
Kuzmin operator and has a good spectral theory. 

Definition 3.3. We say that a T -invariant set Ed [0, 1] x P has good spectral theory 
( GST) if the following conditions are satisfied: 

1. There is a real Banach space V with the property that, for each / G V, the re- 
striction f\E lies in L'^{E,dT-C^'^), and the restrictions satisfy 



{f\E \feY} = L\E,dn'n- 



2. The operator Ccr,E acting on V is compact. 
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3. There exists a cone K cY of functions positive at points of E, and an element 
u in the interior of K , such that C^^e is u-positive, namely for all non-trivial 
f & K there exists k > and real a,b > such that 

au < C'^Ef < bu, 

where the order is defined by f < g iff g — f E K . 

4. For cr = 26e the spectral radius of C25e,e is one, 



The techniques developed by Mayer JT^ then imply that the following properties are 
satisfied. 

Proposition 3.3. Let E be a T-invariant set with GST. Then For all a E I , = 

p{'^ct,e) is a simple eigenvalue of C^^e, dnd the unique (normalized) eigenfunction sat- 
isfying C^Eha = Xaha is in the cone K . There exists a unique T -invariant measure 
on E, which is absolutely continuous with respect to the Hausdorff measure dn^^, with 
density the normalized eigenfunction h25j^. 

Let £* E be the adjoint operator acting on the dual Banach space. There is a unique 
eigenfunctional satisfying C-*^E^tj = Xa^a- For any f eW, we have 

(3.5) hm X-^CIJ = Uf)K, 

n— >oo ' 

with the eigenfunctional £25^ given by f f^f dlH.^^ . The iterates £55^ s/; /^'^ / ^ 
converge to the invariant density h2SE, ^ order of 0{q^), where q is the 

spectral margin: \X\ < qX^ for all points X ^ X^ in the spectrum of Ca^E- Thus, for any 
f eY we have 

1 " r 

(3.6) hm - V(/:V)(/5,t) = h2sAP,t) ■ / fdn'-- 

In particular, given any function F in L'^(E, d'H^'^), we have 
for and any test function / E L'^{E, dTi^'^). 

3.2. Generalized Gauss problem. Let = S x P be a T-invariant subset of [0, 1] 
with GST. 

Let to € P be a base point, and let m„(/?, t) be defined as 
(3.8) mn{x,t) := H^^ {{a E B |x„(a) < x and g'^ia) ■ to = t}) . 
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Lemma 3.4. The measures ( |3.8| ) satisfy the recursive relation 

1 \ A /I / 1 

■ r — 



fc=i ^ ^ ^ 



k " Va; + fc' V 1 k 



and the densities satisfy 

^'n+ii^^t) = {^2SE,Em'J{x,t). 
The measures mn{x,t) converge to the unique T -invariant measure 

m{x,t) := / h2SEix,t) dH^'^{x,t), 



E ^ 

E 



at a rate 0{q^) for some < g < 1. In this case the density satisfies 

h25Eix,t) = -^^h2Ss{x), 

where h25g is the top eigenfunction for the Gauss-Kuzmin operator €25^ on B. 

The proof of this Lemma is a straightforward generahzation of the proof of Theorem 
0.1.2 of 0. 

4. Variation operator 

We introduce another operator, which gives the variation of the Gauss-Kuzmin 
operator along the 1-parameter family, Aa,E '■= -^(^a,E- This can be written in the 
form 

with ATe C N defined as in (^). 
We have the following result. 

Lemma 4.1. Let E he a T -invariant set with GST, and let A^- he the top eigenvalue of 
the Gauss-Kuzmin operator C^^e acting on Y, and let h^r he the corresponding unique 
(normalized) eigenfunction 

(4.2) C^^Eha = Kh.. 

Then we have 



(4.3) 



/ {A25E,Eh25E)dn^^ = X'Ja- 

Je 



-.25 



E ' 



with the operator A^^e in ( [4.1[ ), and with X'^ = ^ 
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Proof. We differentiate the eigenvalue equation ( |4.2| ) with respect to a, and evaluate 
at cr = 26e- This gives 

(4.4) A25E,Eh2SE + ^25E,Eh2S^ = Kse^^^e + Kse^ 

where we used \25e = 1, and we set 



^2Se - -J-ha\a=2&E 



A 

da 

Notice that 



/ (Ks, - C2SE,EKsJdn'- = 0, 

J E 

hence the result follows by integrating both sides of (O). 



□ 

Now we return to the computation of limiting modular symbols The following 



result complements the result of Theorem 2.1 



Theorem 4.2. Let E = B xF be a T-mvanant subset of [0, 1] x P with GST. Then, 
for 'H^'^ -almost every P G B, the Lyapunov exponent satisfies 

(4.5) X{(3) = 2X'2,^, 

hence the limiting modular symbol (|2.1|) is given by 



1 

(4.6) hm — 5^¥.(r%), 



n^oo 2 XL. n — 

2bB k=l 



where ip is defined as in (pl6| 



Proof. The identification (|4.5| ) can be proved using a strong law of large numbers, 
cf. |Tl|], [^. We compute expectations. For (3 = [ai, 02, . . . , a„_i, a„ + we have 

1 It, ^n+2<ln 

Qn+l 1 + 



with Qn the successive denominators satisfying = an+iqn + In-i- We can write 

-1 ^1 / X 1 1 , 1 1 A I ^n+2qn 
log(x„) = — log Qn+l H — log 1 + 



n + 1 n + 1 \ g„+i 

Thus, we can estimate the asymptotic behavior of log(g„)/'^ by the behavior of the 
average on the left hand side, as n — *■ 00. By the convergence of the measures nin, we 
have Jglog(x„) dH^ = Jglog(x) h2s[x) (1 + 0{q"))dT-C^{x). Here h2s{P) is the normal- 
ized eigenfunction of the Gauss-Kuzmin operator on B, and 6e = Sb = S Moreover, 
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we have Jglog(x) h2sdH^ = f^{C25,BF) dH^, for F{x) := \og{x)h2s{x). Notice that by 
^[1]) we also have C2s,bF = —A2s,Bh2S, hence we obtain 



/ \og{x^) dn' = - [ (^25,BM(l + 0(g"))rf7^^ = -A;,(l + 0(g'^)). 
Jb Jb 

Thus, we have expectation 



25) 5 



- / Vlog(a;„)rfH'= (^ + 1)A'25 + 0(1). 
•^^ k=i 

The variances can be computed as 

n+1 „ /n+1 \ ^ 

D'{J2^og{xn)) := / $^log(x„) dn' - (A 
k=l -^^ \k=l J 

and this is estimated by evaluating log(a;fc) log{xk+j)d'H^ = Jg log(a;) \og{y)dm(x, y), 
with dm{x^y) the distribution for the measure of < x and Xk+j{l3) < y}. By 

replacing Xk with a truncation at some large A^, xl = [ofc+i, afc_|_2, . . . ,ak+N], it is 
possible to ensure that dm{x,y) = dmk{x) ■ dmk+j{y){l + 0{q^)). The argument then 
follows as in the proof of the classical Khint chine-Levy theorem |]2l| . 

□ 

5. Vanishing results 



In this section we generalize the weak vanishing result of |]I6[, and improve the 
convergence in average to convergence almost everywhere. 



5.1. Weak convergence. The result of Proposition p!3l implies the following vanishing 
in the average for limiting modular symbols. 

Lemma 5.1. Let E = BxF be a T -invariant set with GST. Then, for all test functions 
f e L\E,dn^^), we have 

(5.1) lim - [ {xo,y{T)}-fdn'^ = 0. 

Proof. The proof is analogous to Lemma 2.3.1 of |T^. We write the limiting modular 
symbol as 



1 

2fl k=l 

Moreover, we have 

! -y^voT^fdn'-=! -y^{c^f)^dn'^. 

J BxF ^ ^^-^ J BxF ^ ^^-^ 
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(ph2SE dTL 



Bxl 



where /i25e = /''25s/|IP|- This gives 



fdn^ 



Bxl 



Arguing as in Lemma 2.3.1 of [|T6| we see that J^s&'^i^) ~ 0' hence the result follows. 

□ 

5.2. Strong convergence. Now we show that, using a strong law of large numbers it 
is possible to improve the weak convergence of Theorem |5.1| to convergence Ti''^ -almost 
everywhere in E. 

Theorem 5.2. Let E = B xF be a T-invariant subset of [0, 1] x F, with GST. Then, 
for Ti.^^ -almost every (3 E E we have = 0. 

Proof. Here we treat (pk = if{T''to) as random variables, and prove that we can apply 
the strong law of large numbers. The argument is similar to the one used in the proof 
of Theorem [4.2| . The result of Theorem f).l\ implies that the expectation E = E{(fk) is 
zero. We evaluate deviations, 



k=l 



dU 



25f 



Here we write |v?fcP for the pairing lyj^p = {ipk,'^k), where 

{ipis), ifit)) := {giO),git^)}G • {/^(O), /i(«oo)} 

with s = gG, t = HG, and • the intersection product, cf. [p 
When writing 

n n—k 



G, 



It n IL IL n, n 

k=l k=l 1=1 



we want to estimate the difference 

(5.2) J {ipk,ipk+j) - {j Vk, j ^k+j)- 

Let P{g^^{P) ■ to = t) be the probability that g^^{l3) ■ to = t, that is 
Pi9k\P) ■to = t)= [ dmkix, t)dn^\x) = mfc(l, t), 



B 
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for ninixjt) defined as in ( p.8| ). We can write ( |5.2| ) as 

E.6FEtep(</'(s),¥'W) iPi9k\/3)-to = s and g;l^{f3) ■ to = t) 

-Pi9;\P) ■to = s)- Pi9,l^if3) ■ to = t)). 

It is then enough to show that these are sufficiently well approximated by weakly 
dependent events, namely that we have 

Pi9,\f3yto = s and 9khi(3)-to = t) = P{9u\Pyto = s)-Pi9,U/3yto = t)(l+0(g^)). 

By the result of Lemma we know that the measures mn{x, t) converge to the limit 
T-invariant measure m{x,t) at a rate 0{q"'). However, the probability distributions of 
Xk{P) and Xk+j{P) do not satisfy the weak dependence condition 

m{x,y) = mn{x)mn+j{y){l + 0{q^)). 

However, by proceeding as in the proof of Theorem [4.2| , we consider a truncation at 
some large iV, x*^ = [ak+i, ak+2, ■ ■ ■ , Ofe+Af], so that the probabilities 

m;(x, t) = {{a e [0, 1] \xl{a) < x and 9^\a) ■ to = t}) 

satisfy the weak dependence condition. This gives the desired result for the probabilities 
Pi9k\P) ■to = s and 9kljiP) " = t). 

□ 



6. Examples 

We discuss some examples of invariant sets with GST that are relevant to the bound- 
ary geometry of modular curves. 



6.1. Generalized Gauss— Kuzmin operator. This is the case analyzed in |]T6|. In 
this case the function space V is the real Banach space V^(D x P) of functions holomor- 
phic on each sheet of D x P and continuous to the boundary, real at the real points of 
each sheet, with D = {z G C| — 1| < 3/2}. The space is endowed with the supremum 
norm. The generalized Gauss-Kuzmin operator acts on this space V, for cr > 1/2. An 
additional hypothesis on the subgroup G C PGL(2, Z) is needed, namely the transi- 
tivity condition that the coset space P contains no proper invariant subset under the 
action of the semigroup Red = U„>iRed„ C GL(2, Z), with 

.1) Red„ = <i ( ? „)•••(? } 1 I ai, . . . , a„ > 1; Oi e Z 



1 ai J ' ' ' \ 1 a. 

This ensures that [0, 1] x P has GST. In this case, the T-invariant measure on [0, 1] x P 
is given by 

(6-2) ^(^''^^ = ^i^^°s(^ + ^^' 
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where 1/(1 + /?)log2 is the invariant density of the classical Gauss problem for the 
shift T(3 = 1/(3 — [1//9]. Thus, in this case we obtain an improvement on the weak 
convergence result of ]TB|. 



Corollary 6.1. Assume that Red(t) = P for each t G P. Then the limiting modular 
symbol satisfies {{*,P}}g = ^^^r^oo 7 {xo,yiT)}G = 0, for almost all j3 G [0, 1]. 

6.2. Continued fractions Cantor sets. There is a family of Cantor sets associated 
to the continued fraction expansion of numbers in [0, 1], namely the sets E^^ given by the 
numbers a G [0, 1], a = [ai, 02, . . . , a^, . . . ], with all < N . These sets have Hausdorff 



dimensions which tend to one as — > 00 according to the asymptotic formula |10 



:= dim„(i5„) = 1 - ^ - + 0(llN\ 

As before, let G be a finite index subgroup of PGL(2, Z), and P be the coset space. 
There is an action of the shift operator T restricted to the space E'at x P, where En is 
one of the Cantor sets as above. 

The Gauss-Kuzmin operator is of the form 

(6.3) i^.^!)iM = tj^j{j^,{ \ 



acting on the Banach space B defined in §1.1 of ||16|| . 

In the case G = PGL(2, Z) the properties of this operator were studied by Hensley in 
|TD[, where, using a functional analytic setup similar to Babenko's [^, it is shown 



that for a = 25n, there is a unique eigenfunction fNiP) of ^25n,n, with eigenvalue 
A = 1, which gives the density of an invariant measure. 

Following Hensley, we can consider the truncated Gauss-Kuzmin operators i2o-,Af as 
perturbations of the Gauss-Kuzmin operator Cg on [0, 1]. 

Proposition 6.2. Under the assumption Red(t) = P for each t G P, and for suf- 
ficiently large N > No, there exists a unique eigenfunction fN{j3,t) of the operator 
'^Sn,n of (p. 3D, with eigenvalue A = 1. This satisfies 



(6.4) /^(/5,t) = ^/^(/3), 

where fN^P) is the unique normalized eigenfunction of the truncated Gauss-Kuzmin 
operator of g, 0, for a = 25n, and P = {1}. 



Proof. The assumption Red(t) = P for each t G P ensures that the Gauss-Kuzmin 
operator for the shift on [0, 1] x P has GST for a > 1/2. 
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For large N, we consider the operator Ca,N as a perturbation of Ca- We estimate 
the operator norm of T^^n = — C.a,N- We have 



T^,Nfix,t) = ^ fc- 



1 



k=N+l 



1 /O 1 



{x/k + ly \x + k' \1 k 



it) I 



hence 



k=N+l 



-J 



1 /O 1 



(1 + x/ky \x + k'\l k 



it) 




for (J complex with real part '^{a) = t] > 1/2. 

One can then apply the Crandall-Rabinowitz bifurcation Lemma (cf. Lemma 7 
of [l^), which guarantees the existence of a 5 > 0, such that, for ||To-,Ar|| < 6, there 
is a unique Po-^iv ^ C, with \pa,N\ < for which L^- — (Ag- + Pa,N)I is singular. The 
map To-,7v ^ P(T,N is analytic, in the sense specified in |]10|. Moreover, there exists 
a unique f^^N satisfying 

{Co- + To^N)fu,N = (Act + Pa,N)fa,N, 

and the map Tct^at i— >■ fa,N is also analytic. By uniqueness, the eigenfunction for a = 
2Sn is therefore of the form fisf{j3,t) = /Ar(/3)/|P|, with fN^P) the unique normalized 
eigenfunction of the truncated Gauss-Kuzmin operator of Hensley. 

□ 



The eigenfunction fN{P, t) of the truncated Gauss-Kuzmin operator defines the den- 
sity of a T-invariant measure on x P absolutely continuous with respect to the 
^AT-dimensional Hausdorff measure dTC^^ . 

We then obtain the following vanishing result. 

Lemma 6.3. Consider infinite geodesies in the upper half plane with an end at ioo and 
the other end at a point of En- For sufficiently large N > Nq, the limiting modular 
symbol satisfies 

n 

{{*, p}}a = hm -— — J2 MPr%) = 0. 

Notice that the constant A^^o provided by the Crandall-Rabinowitz bifurcation Lemma 
is independent of G C PGL(2, Z). 
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7. Intersection numbers 



In the classical theory of the modular symbols of |T^, []T^ (cf. also [Q, [|T^) cohomol- 
ogy classes obtained from cusp forms are evaluated against relative homology classes 
given by modular symbols, and the corresponding intersection numbers are interpreted 
in terms of special values of L-functions associated to the automorphic forms which 
determine the cohomology class. In this and the next section, we seek to extend this 
viewpoint to the theory of limiting modular symbols. We first recall the setting of , 



which provides a convenient setting for computing intersection numbers with limiting 
modular symbols. We consider finite index subgroups G C PSL(2,Z). The arguments 
given for PGL(2,Z) adapt with minor modifications, cf. |13|, [0- 

Let / and R, be the elliptic points on the modular curve Xq, namely the image 
under the quotient map : HI — > Xq of the PSL(2,Z) orbits of i and p = e^'^*/^, 
respectively. With the notation of |T^, we set := Hi{Xg \ A, B; Z). The modular 
symbols {g{0), g{ioo)}, for gG G P, define classes in if^usps^ p^^, ^ ^ ^.j^g generators 
of PSL(2, Z) with = 1 and = 1, we set P/ = (a)\P and Fr = (r)\P. There is an 



isomorphism 



and 

the image vr/(x) 
an element x G 



ttR 

cuspsU/' 



Given the exact sequences 



cusps 



H. 



R 

cusps 



zi 



^ zi^^i 

of an element x 



ttR 

^ cusps U/ 



H. 



R 

cusps 



cusps 

iff the image t^r{t^i{x)) 



cusps 



in 



Z ^ 
in ZIP 



= H^uspsui represents 
As proved in 



for 



s = gG G P, the intersection pairing • : H'^^^^^ x if, 



cusps 



Z gives 



{g{0),g{ioo)} • 
P ^ R by 

AJs) = A 



X 



A., — Xn 



We define the function 

(7.1) A,(s) = A, - A,„ 

where x is given as above. 

We list some examples of results involving intersection numbers that easily follow 
from the general results of the previous section. 

Example 7.1. For a fixed x G -ffcusps, represented by a linear combination x = 

^^gpAsS in Z'""! satisfying 7r/j;(7r/(x)) = in Z''^^', the asymptotic intersection number 



{{*,/?}} •x:= lim -{xo,yiT)} • X 

r— >oo T 



(7.2) 

is computed by the hmit 

1 " 

(7.3) limy-^5^A.(^7,-^(/3)-to 



k=l 
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where A(/3) is the Lyapunov exponent. Let E he a T-invariant set with GST. For 
?-^''^ -almost all /? G -E, the sequence ( |7.3| ) converges to 



A|P| 



In the following example, we consider a cusp form $ on H, obtained as the pullback 
$ = ip*{uj)/dz under the quotient map ip -.M. —>■ Xq, and intersection numbers A^(s) = 
Jl^l^^ ^z)dz, with gsG = se P. 

Example 7.2. Let $ be a cusp form on H, and let (3 he a number in [0, 1] with 
eventually periodic continued fraction expansion with period of length i. Then we 
have 

(7.4) lim - / ^z)dz = ——y ^z)dz = -— ^z)dz. 

Here $ is a cusp form, ^{z)dz = (p*{uj), with u representing the dual of the class x. 
The integral homology class {0,g{0)}G is determined by the periodic geodesic with 
P = a^, g & G, and with X{g) = logA". 



The following example follows by arguing as in Theorem 3.5 of |14 



Example 7.3. Let G = ro(A^), and let $ = (f*{uj)/dz he an eigenfunction for the 
Hecke operators T^, for (m, N) = 1, with rational eigenvalues c^, and let (3 he a. 
quadratic irrationality with period of length i in the continued fraction. Then we 
obtain 

lim / ^z)dz = -—- TTTT^y^ Z2 / Hz)dz, 



Xo 



with cr(m) = d, and for infinitely many m with (m, A^) = 1, 

Example 7.4. Let be a T-invariant set with GST. For g G PSL(2, Z), consider the 
factor U{g, z) of the form 

a b 



U(g,z) = - —T for g ^ , , 

^ ' {cz + dy \ c d 
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and set $(2;) := XlteP ^yz)^i9t ^z)- This satisfies 

A;=l I I "'0 II ^gp 

for Ti''^ -almost all For instance, for some G = Tq{p) with p prime, the value 

of this limit can be computed from the tables at the end of [1^ 



8. AUTOMORPHIC SERIES ON THE BOUNDARY 



In |T6[ it was proved that cusp forms of weight two for congruence subgroups (or 
rather their Mellin transforms) can be obtained by integrating along the real axis cer- 
tain "automorphic series" defined in terms of continued fractions and modular symbols. 

In particular, the following identity was proved: for 3fJ(t) > 0, 



n=0 



1+t 



{0, 



i»+l(/3) 



} 



gi + t) LL''\2 + t) 



(N) 



where the cusp form $ = (p*(uj)/dz is an eigenform for all Hecke operators, Li^ ' is 
its Mellin transform with omitted Euler A^-factor, ({s) is Riemann's zeta, with corre- 
sponding Various generalizations of this average are also discussed in |]l6i. The 



main point in considering such averages is in order to recast the theory of modular forms 
in the upper half plane in terms of some function theory on the "invisible boundary" 
F\R) of Xg. 

The general type of functions considered in §2 of 



16 is of the form 



(8.2) 



^(/,/5) = E/(^'^(^)'^'^-i(^))' 



fc=i 



for / a complex valued function defined on pairs of coprime integers (g, q') with q > 
q' > I and with /(g, q') = 0{q~^) for some e > 0. The identity 



q>q'>l 

(g,g') = i 



f{q,q') 
q{q + q') 



which is used in to prove ( |8.1j ) and various generalizations, is a result of Levy, 
|T^. In our viewpoint, the summing over pairs of successive denominators is what 
replaces modularity, when "pushed to the boundary". This correspondence between 
Dirichlet series related to modular forms of weight two and integral averages of such 
"automorphic series" on the "invisible part" of the boundary of Xq is reminiscent of 
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the physical principle of holography, or Maldacena correspondence. We shall return to 
discuss this relation in a separate work. 

In |TB| only averages J^^ ^^i{f, P)dp were considered, and their relations to modular 
forms. Here we discuss the pointwise behavior, and prove that it is possible to use 
such expressions to construct non-trivial homology classes associated to a geodesic 
with "generic" endpoint in [0,1], and a function / in this Levy class. We shall only 
discuss the example of identity (|8.1|) , but similar arguments hold for the other functions 
considered in iTGll. 



Theorem 8.1. Consider the function 

(8.3) = 

Let i{f,P) be the corresponding function as in ( p.2| ). We can estimate 

oo n 



i{f,f3) ~ 5^e-(^+2*)'^^('^) 5^ A.(^,-^(/?) . to) 



n=l k=l 

Thus, if E be a T -invariant subset with GST, and with < X'2s^ < oo, the series 
defining i{f,l3) converges absolutely, for H^'^ -almost all P E E. 

Proof. We can estimate 

QniP) + Qn+ljP) -{5+2t)n\{/3) 

Wi(/3)^+* 



with X{/3) = 2 lim^^oo log (gn )/■"■• Moreover, by equation (2) of §1 of we can write 
{0,-}= $]{^,-}= Y.i9,\b/am,g,\b/a){z^)}, 

where fc/t/afc are the successive convergents of the continued fraction expansion of the 
rational number b/a = bnjcin- 

Recall that, in terms of continued fractions, we can write the rational numbers 

[a„, a„_i, ... , aij. 



?n+l(/5) 

where 

/? = [Oi, 02, . . . , a„, Ctn+l; . . . ]. 

Since the successive denominators g„, viewed as polynomials 

9n(/?) = Qn(ai, . . . ,a„), 

satisfy 

Qnip^Xi ■ ■ ■ , On) = Qn{(ln, ■ ■ ■ , ^l), 
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we have, for ^ri{P) ■= QniP) / qn+i{P) , 



for k < n. Hence the estimate on i{f,/3) follows. Then arguing as in Theorem |5.2| we 
obtain 



o(A(/3)n) 



k=l 

hence the series converges absolutely. 

□ 



In fact, this proves a stringer result, namely that we can construct this way non- 
trivial homology classes depending on the point (3 and on the function /. 

Theorem 8.2. Let E be a T -invariant subset of [0, 1] x Pro(Af) with GST, and with 
< y^^Ss ^ Then, for Ti.^'^ -almost all (3 E E, and for 3?(t) > 0, the limit 

(8.4) C(/,/3):=f *=±i<^?I±^|o.^| 

defines a class C{f,l3) in ifi(Xro(Ar), M). The function i{f,P), for f as in (|8.3| ), can 
be written as 



Proof. For G = ro(A^), we have 

Then the same argument used in Theorem |8.1| proves the result. 

□ 

The average dp J^j^jr^^iv satisfies (|8.1|). It would be interesting to know if aver- 
ages over other T-invariant subsets, J^d'H^'^(P) J^^^^^cj also carry number theoretic 
significance. 

9. Selberg zeta 

The Selberg zeta function of a modular curve Xg, for G a finite index subgroup of 
PGL(2, Z), can be recovered from the Fredholm determinant of the generalized Gauss- 
Kuzmin operator, namely 

(9.1) det{I-C2s)=ZG{s), 
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for s G C with 3?(s) > 1/2. The result holds for G C PSL(2,Z) with replaced by 
see §, |T§ for the general case, and [0 for the case G = PSL(2, Z) or PGL(2, Z). 

We investigate possible generalizations of this identity when only geodesies with ends 
on some smaller T-invariant subset are considered. 

Given a T-invariant subset E C [0, 1] x P, we can define 

oo 

(9.2) Zg,e{s) ■■= n ~ g-(.+m)length(7)) ^ 

7gPrim£; m=0 

where Prim^; is the set of primitive closed geodesies in Xg that lift to geodesies in H x P 
with ends at points of E. Notice that, in general, little is known about the properties of 
such zeta functions. For instance, whether they still have a meromorphic continuation, 
or if there is a trace formula relating ( |9.2| ) to the spectrum of the Laplacian on some 
suitable space of functions. 

Regarding the relation of (|9.2D to the Gauss-Kuzmin operator, the following result 



is a simple generalization of the results of |T6l and [|T^. It applies, for instance, to 
Hensley's Cantor sets of continued fractions En x P. 

Proposition 9.1. Let E be a T-invariant subset of [0, 1] x P with GST, which is of 
the form E = B x ¥, with 

(9.3) B = {f3e [0, 1] : a, G X} 
for some A/" C N. We have a trace formula 

(9.4) det{I - C2s,e) = ZgA^)^ 

where C2s,e = T^h is the Ruelle transfer operator, with a = 2s G C, 9?(s) > 1/2, 
h = —slog \T'\, and the right hand side is defined as in ( |9.2|) . 

Proof. We denote by ir^^k the operator 

{TTa,kf){x,t) = ——f 



for (T G C, 3?(cr) > 1. We can write ( p.4|) as the operator 

(9.5) 5^ 7r.,fc/. 

k&^^ 

The same argument of shows that this is a nuclear operator of order zero in the 
sense of [0 on a complex Banach space of holomorphic functions defined on a domain 
D X P containing i?, for 9ft(cr) > 1. Thus, we have 



oo rj, pl> CO 



TrC 

1=1 \ e=i \keAf 
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where ^^{g) = llf=i'^a,aj, and 



Red^; := < g E Red 



Here we denote by Hyp^ a set or representatives of the conjugacy classes of hyperbohc 
matrices in GL(2, Z) which contain reduced representatives in Red^;, and 

. ^ Nig)-^ 
X2s{9) - 



l-detig)Nig)-^- 
for 



N{g) 



I ^Trig) + D{gY/y 



and D{g) = Tr{gY — Adet^g), and is defined as Tg := G P : ■ t = t}. 



The argument now follows the lines of [0. Under the hypotheses on E, (|9.2| ) is of 
the form 

oo 

(9.6) zg,e{s)--= n n d^^i - ' 

gePriiiiE r?i=0 

where p^ig) is the action of g on P, and Prim^; is the set of primitive hyperbolic 
elements, g = h^'^3\ g E Hyp^;. We write (|9.6| ) as 



oo oo 



E J2^rJ2Uet{gr''N{gr(^^"^^'p^{g' 



k 

ggPrirtiE m=0 k=l 



oo 



^ ^ 1 N{g)-''%. 1 . . 

^ ^fcl-det((7'=)iV((7)-'= ^ 

where Tr{pf>{g)) = Tg. The argument underlying the passage from summing over Prim^; 
to the summing over Hyp^; is exactly as in |13[, by observing that if a conjugacy class 
in Hyp contains a representative in Red^;, then all the i{g)/k{g) representatives in Red 
are also in Red^;. Thus, we obtain 

- log det(/ - C„^e) = - log Zg,e- 

□ 
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It is easy to see where this argument breaks down when less strong assumptions 
are made on the invariant set E. For instance, for a T-invariant subset E = B x F, 
we can consider the sets Red^;,^ = {g E Red^ : [ai, ... ,ae] G 5}. Even assuming that 
all the corresponding operators iTaig) are of trace class, we no longer have the identi- 
fication of the term J2geRedE e^'^^^^ with (Xln^o-.^)^' hence we can no longer identify 
^'"(S^i i J2geRedE e with the Fredholm determinant of a Gauss-Kuzmin opera- 

tor. Many interesting examples of invariant subsets, such as level sets of the Lyapunov 



exponent, do not satisfy the assumptions of Proposition However, in certain cases, 
it is still possible to identify ( |9.2D with a Fredholm determinant, albeit for a different 
Gauss-Kuzmin operator. 

9.1. Example: minimal Lyapunov exponent. The minimal value attained by the 
Lyapunov exponent at periodic points of the shift T on [0, 1] is given by 

Co = 2 log I — — 

Let Leg be the level set of the Lyapunov exponent Lc^ = {P E [0, 1] : X{/3) = cq}. 

Proposition 9.2. Consider the dense T-invariant subset of L^^ x P c [0, 1] x P. The 

zeta function ( p.2| ), with Geod^; the set of primitive closed geodesies in Xq which lift 
to geodesies in EI with end in satisfies 

det(/ — £2s,£;ixp) = -^cLcqxpIs), 

for s G C, 3fJ(s) > 1/2, where C^^Eixt is the transfer operator associated to the Hensley 
Cantor set En x P for N = 1. 

Proof. The level set of the Lyapunov exponent consists of all /5 G [0, 1] whose 
continued fraction expansion has a proportion of I's which tends asymptotically to 
100%, cf. Thus, is an uncountable dense subset of [0, 1]. The only eventually 
periodic points in Leg are numbers with partial quotients in the continued fraction 
expansion eventually equal to 1. Thus, we have 

/ °° 1 \ °° 1 



i=l geRedi^ 



for 



{C2s,Ej){x,t) = . ^ .^J 



1 

x + iy-'' \x + v \ i 1 



□ 



A case which is especially of interest, in relation to Manin's theory of real multipli- 
cation [|T3] , and which also does not fit into the assumptions of Proposition ^TT| is the 
case of geodesies in EI with ends at quadratic irrationalities in a real quadratic field 
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Q{\/d). One can separate out the Selberg zeta function into contributions of different 
real quadratic fields and seek for corresponding Gauss-Kuzmin operators. We shall 
return to this in future work. 

10. C*-ALGEBRAS 

We show how T-invariant subsets of [0, 1] x P can be used to enrich the picture of 
non-commutative geometry at the boundary of modular curves, already illustrated in 

H- 

Consider a T-invariant set E = B xF, where B is defined by a condition on the digits 
( |9.3|) , for Af C N. Such sets are totally disconnected compact T-invariant subsets of 
[0, 1] X P. Let C{E,Z) be the space of continuous functions from E to the integers. 
We denote by C{E,Zf the invariants C{E,Zf = {/ G C{E,Z) | / - / o T = 0}, 
and by C{E,Z)t the co-invariants C{E,Z)t = C{E,Z)/ B{E,Z), with the set of co- 
boundaries B{E, Z) :={/-/ o T I / e C{E, Z)}. 

We recall the following result (see e.g. 0). 

Proposition 10.1. Let E be a totally disconnected compact Hausdorff space. There 
is an identification Kq{C{E)) = C{E,Z), while Ki{C{E)) = 0. Moreover, there is an 
exact sequence 

^ C{E, Zy KoiC{E)) KoiC{E)) C{E, Z)t 0. 
The set of co-invariants C{E, Z)t is a unital pre-ordered group, {C{E, Z)t, C{E, Z)^, [1]). 

The pre-order structure is given by specifying the positive cone C{E,Z)^ and an 
order unit, namely an element u G C{E,Z)^ such that, for all [/] G C{E,Z)t there 
exists a n G Z, n > 1, such that nu — [f] G C{E, Z)J. Here we set: 

C(E,Z)+ := {[/] G CiE,Z)T\3fo G C(E,Z), [/o] = [/],/o > 0}, 

with order unit u = [1], the class of the constant function on E. 

The pre-ordered groups for T-invariant E defined by ( p.3| ) give a collection of in- 
variants describing some features of the non-commutative geometry at the boundary 
of the modular curve Xq- The arithmetic relevance of these invariants remains to be 
understood. The structure of these pre-ordered groups can be studied through traces. 

10.1. Invariant measures and traces. Recall that a trace on a unital pre-ordered 
group {C{E,Z)t,C{E,Z)^, [u]), where E is a. totally disconnected compact Hausdorff 
space invariant under T, is a positive homomorphism r : C{E, Z)t M, where positive 
means that it sends the cone C{E,Z)^ to M-°, which moreover satisfies t{u) = 1. 
Normalized Borel T-invariant measures on E define traces by integration, 

r([/]) = / fdf,. 

J E 
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Thus, if the invariant set E has GST, so that we can prove the existence of an 
invariant measure, we have an associated trace on C{E,'Z)t 



/ fhs^EdH"^. 

J E 

10.2. Cuntz— Krieger algebras. Consider a T-invariant set i? = i? x P, where B is 
defined by the condition (|9.3|) , with A/" C N a finite subset. Then we can further enrich 
the picture of the non-commutative geometry at the boundary of the modular curve 
Xg, by considering a C*-algebra associated to the dynamics of the shift T on in 
the form of a Cuntz-Krieger algebra Oae for a matrix Ae, see 0, 

Example 10.2. In the case of the Hensley Cantor sets, the shift T on E^^ is a full 
one-sided shift on symbols. For P = {1}, the associated C*-algebra is the classical 
Cuntz algebra On- In general, we consider the Markov partition given by 

^iv:={((^,t),(j,s))|f/,icr(f/,g}, 

where z, j G {1, . . . , A^}, and s, t G P, with sets Ui^t = Ui x {t}, where Ui C En are the 
clopen subsets where the local inverses of T are defined, 

U + ij. 

The condition Ui^t C T{Uj^s) corresponds to 

1 



HE 



N- 



. , t = S. 

1 3 

The Markov partition determines a corresponding NpxNp matrix An, for p = |P|, with 
entries {AN)is,jt = 1 if Ui^t C T{Uj^s) and zero otherwise. We obtain a Cuntz-Krieger 
algebra Cajv- 

There are numerical invariants that can be extracted from the non-commutative 
geometry of such Cuntz-Krieger algebras, and our hope is to show that some of these 
recover the rich arithmetic structure of modular curves. An instance where some of this 
structure is recovered using C*-algebras is the result of [|l6l, where we showed that from 
the Pimsner-Voiculescu exact sequence for the C*-algebra C(P^(M) x P) xi PSL(2,Z) 
one can recover Manin's presentation of the modular complex. 

Acknowledgement. Conversations with Yuri Manin were a great source of inspira- 
tion. 
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